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IMPROVEMENTS RELATING '1 0 BRAILLE EQUIPMENT 



FIELD OF THE INVENTION 



5 This invention relates to apparatus and methods which assist the use of electronic documents 
in both Braille and word processor cuvkoimients. In particular it relates to apparatus and 
methods which facilitate conversion of electronic documents between various formats for 
subsequent use on word processor equipment and Biaillc equipment as required. 



10 BACKGROUND TO THE INVENTION 



Braille k a literary medium designed to assist visually impaired people to communicate in a 
written form. Standard Braille is based on tactile symbols each comprising combinations of 
up to six dots on a 1 by \ matrix which can be embossed onto paper, each symbol i elating to 
15 a character, Ougmal Braille embossers comprised mechanical devices with six keys each 
relating to one of the six dots A Braille page typically has up to 40 Braille symbols per line 
and 25 lines per page 

In some languages*, foi example in English, French and German, there are two grades of 
20 Braille, In Grade 1 each letter of the standard alphabet translates directly ro a Braille symbol 
which is formed by the an ay of 2 x 3 dots, sometimes referred to as a Braille cell There are 
special symbols and combinations of symbols for capitalisation., punctuation, numerals and so 
forth. Grade 2 Braille comprise* giade 1 and, in English, 189 contractions. For example the 
Grade 1 symbol for the letter "b" becomes "but" if it is preceded and followed by spaces. 
25 Similarly "k f * becomes "knowledge". Special symbols exist for the common letter groups such 
as "ed\ "ch", M gh" and so on. 

In addition to being embossed onto paper, Braille may be created and stored electronically and 
displayed on a refreshable Brailk display. The Biaillc display is similar to a short line of 
30 embossed Braille and is read in the same manner Electronic Rraille displays are comprised 
of cells with the same pattern of dob da embused Biaillc. Modem electronic Braille displays 
comprise a linear array of up to 80 identical Braille cells using pipy?n-electnc crystals. Each 
dot of each cell is actuated by a piczzu elcaiic ciystal that bends up to raise a pin (dot present) 
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or bends down lo lower the pin (dot absent), To facilitate use of Braille in computer 
environments, computer Braille has been developed in both six and ei^hl dot versions. For the 
eight dot version rv\ ; o exLra duts aic arranged with the standard size dots in a 2 by 4 pattern to 
represent additional characters used in computer environments, for example the ASCII 
5 character set. The extra dots are associated with two more keys on the Braille keyboard. 

RrziUe. notetakers are portable electronic devices which assist visually impaired people to 
create* manage and exchange information in a manner simitar to those people who use stamlaid 
personal digital assistants (PDAs). A typical Braille notctakcr provides applications such as a 
10 word processor, address list, day planner, phone book and the like, and has various input and 
output devices for operating the software, for example, a Braille keyboard, standard keyboard, 
tactile Braille display and synthesised voice output. Documents created using these 
applications can be edited, printed, emailed and saved as inquired. 

1 5 Often a user of a Braille notfttaker needs to exchange document with users of standard word 
processing programs operating on computers or PDAs. Such documents however do not 
translate well between the two environments as much of the document foi matting, such as page 
layout, character attributes and die like is lost. For example a Braille document has a standard 
layout which differs from that ol documents created and saved usin^ well known word 

20 processors such as Microsoft Word™ or WordPerfect* - The nch text of such a word 
processor document, along with layout features such as tables and tabs ate also lost in 
translation. Further, documents created in one of the environments are always not suitable tor 
use in the other environment. For example special features which are provided in a document 
by a Braille notetakcr to assist visually impaired people to use the document arc lost in 

25 translation to a word processor format It would he desirable therefore to have a notetakcr 
which assists the use of electronic documents in both a Braille and word processor 
environment. 

SUMMARY OF THE INVENTION 

30 

It is an object of the present invention to effect transfer of an electronic document bet ween 
various formats to enable use of the document in both a Braille environment and a word 
processor environment. Preferably the electronic document is transferred between furniats in 
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a manner which is transparent to the user such thai ii appeal's only one document is being 
worked with. 

The term "Biaillc environment" broadly refers to the Braille types and formatting conventions 
5 which specify the nature of Kraille symbols and documents, and the equipment utilised to 
create, edit, save and review both electronic and hardcopy Braille documents. The term *^ord 
processor environment" broadly refers to the hardware and software, such as a PC running a 
word processor like MicruSoIl Word™, used to crcatc 3 edit and review standard electronic teat 
documents, and the file formats used to store such documents. 

HI 

In one aspect the present invention may be said to consist in a method for converting an 
electronic document berween a format foi use in a Draillc environment and a format for use in 
a word processor environment including: receiving input m a first of the environments 
specifying the electronic document, storing the electronic document in an intermediary file 
15 format, and converting the electronic document from an intermediary formal into an destination 
format adapted for use in the second of The environment*, wherein the intermediary format 
specifies the electronic document formatting in at least one of the environments. 

In another aspect the present invention may be said to consist in an apparanis which enables 
20 use of an electronic document in a Braille and a word proec^ui environment including: at least 
one document input device in a first of the environments for entering an electronic document 
into the apparatus a storage device for Storing the electronic document in an intermediary 
format, and translator for converting the electronic document from the intermediary format into 
a destination format tor use m the second of the environments, whciein die intermediary format 
25 specific* the electronic document formatting in at least one of the environments 

The invention may also be said to consist in any alternative combination of parts or features 
as described or shown m the accompanying drawings. Known equivalents of these parts or 
fcaluies not expressly set out arc nevertheless deemed to be included 

30 
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BRIEF LIST OF FIUUKES 

Preferred embodiments of the invention will be described with reference to the accompanying 
drawing uf which; 

5 Figure 1 is a schematic diagram showing a geiicial airangcment of apparatus for 

facilitating the transfer of electronic documents between a word processing and Braille 
environment, 

Figure 2 is a flow diagram showing the general operation of apparatus for facilitating 
electronic document transfer, 
10 Figures 3 and 4 arc flow diagrams showing preferred methods of converting an 

electronic document into an intermediary 1 format, 

Figure 5 is a flow diagiam showing a preferred method of translating an electronic 
document from an intermediary format to a word processor format. 

Figures 6 to 7 are flow diagrams showing a preferred methods of sending an electronic 
1 5 document to an output device in a Braille environment, 

Figures 9A and 9B show the general btiucture of a temporary file in an intermediary 

format, 

Figure 10 is a schematic diagiam of a Braille notctaker for creating Braille documents 
and converting electronic documents between Braille and word processing formats, and 
20 figures 11 and 32 are schematic diagiams showing further detail of the software 

implemented on the CPU. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODLMKN'i S 

25 Referring to the drawings it will be appreciated that Braille notetakers according to the 
invention and their functionality can be implemented in various forms. The following 
examples arc given by way of example only. The various types of Braille and the various 
formats for storing electronic documents will be known, to those skilled in this area of 
technology and therefore will not be described in detail Braille code and Unicode specify 

30 individual characters in a format suitable for compute! Hie storage and details of these codes 
will also be known to the skilled reader. 
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Figure 1 shows the general nature of a Braille notetaker 10 according to the invention and its 
intcrrclationshjp with hardware operating in a word pror.ftssnr environment 17. The notetaker 
1 0 assists in creating, editing, embossing, printing and reviewing electronic documents^ and 
converting electronic documents between formats suitable for use in either a Braille 16 or a 
5 word processor 1 7 environment. Typically an electronic document will be a letter, report, or 
utlicr literary work usually produced on a word processor. The notetaker 10 includes Braille 
environment input devices 1 i for creating new and/or retrieving existing electronic documents, 
and output devices 12 for rendering electronic documents in either electronic or hardcopy form. 
The input 1 1 and output 12 equipment can be mechanical or electronic in nature and may 

10 include devices such as Braille keyboards, standard keyboards, speech recognition devices, 
disk drives, tactile displays, speech synthesisers, printers, embosser* mid visual display units. 
The nulclakei 10 also includes a computer device 13 which communicates with the input 1 1 
and output 12 devices, and lacihtates electronic document conversion between different 
formats for use in two environments 16, 17. The computer device 13 stores electronic 

15 documents as temporary files in an intermediary format, and performs Translations of the 
electronic documents between various file formats as required. The notetaker 10 is adapted to 
communicate with a standard word processor setup 15, such as word processor software 
running on a PC, to facilitate Uansfciral of documents between the environments 16, 17. Such 
communication may take place over the Internet, or by any other nerworking or interconnection 

20 means which will be known lu those skilled in tin's area of technology. Using the arrangement 
shown in Figure 1 an electronic document can be created or read in either of the environments, 
converted into another fumwl compatible for use in the other environment and then transferred 
to the other evironment for use. 

25 The notetaker 10 which forms part of the arrangement depicted in Figure 1 facilitates 
conversion of electronic documents between Braille and word processor formats to enable a 
user to work with the document in both environments The arrangement further enables 
information relating to the formatting of the document in each environment to remain 
independent. Document formatting refers to the manner in which the electronic document is 

30 rendered in its destination cimioimieiit, for example the page and text/Braille layout character 
attributes, table arrangements, line/page numbering and the like. This differs from the term 
electronic document format which relates to particular file format which the computer uses to 
store the electronic document in memory or on a storage device. The functionality of the 
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notetaker 10 is such that altering die formaning of a document in the Braille environment 16 
docs not affect the formatting of a document in the word processor environment 1 7 and vice 
versa. It should also be noted that the formaning in both environments can be altered if 
required, such as when a table is edited by removing one row. This enables ink print and 
5 embossing versions of the document to remain separate and to be indcpci idently edited. 

Figure 2 shows the general nature of a document environment transfer opciatlon which the 
noietaker 10 facilitates. Initially the notetaker receives 20 an electronic document from a source 
which can originate from either of the environments 16. 17, in one of a variety of fonus. For 

1 0 example the electronic document may be a word processing document which is imported from 
a word processing environment. Alternatively the document may be a Braille or text document 
which has been creaLed using a Braille notetaker and subsequently stored on disk. In yet 
another possible alternative, the notetaker 10 receives the document as it is created using a 
Braille or standard keyboaid piovidcd. As the document is read from a memory source or 

15 typed into the notetaker 10, each element of the document, which may be for example a 
character or formatting code, is saved into a temporary file which stores 21 the document in 
an intermediary format The temporary file is a working tile which is retained in computer 
memory and used for document conversion puiposes to enable the user to work with the 
electronic document in either the word processor 1 7 or Braille environment 16 as required. The 

20 document stored in the intermediary format includes information relating to how the document 
should be rendered in each environment 16, 17. 

The U3cr selects the desired output environment and the stored temporary file is then converted 
22 from the intermediary format into a suitable fonuat for the selected output environment. For 

25 example, should the user wish to export the document to a separata word processor, for 
example as an e-mail attachment, through a nciwoik, or on a portable disk, the notetaker 1 0 can 
convert the temporary file to the desired word processor format using a translator, The 
converted document is then sent 23 to a selected output device for example, a printer or visual 
display operating in a word processor environment 17, or an embosser or tactile display 

30 operating in a Braille environment 16. The document is then rendered on the output device in 
accordance with the formatting specified for the output environment Preferably the apparatus 
operates in a manner such that the transfer between formats is transparent so it appears to the 
user that only one document is being worked with. 
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Figure 3 shows in more detail one aspect of a preferred operation of the notetaker 10, Using 
word processing software which is implemented on the notetaker 10 an operator creates 30 a 
new document using a standard keyboard. Braille keyboard, voice recognition system or other 
daia input means. The software is similar in function to a standard word processor with 
5 adaptations for use in a Braille environment 16. Typically the document created will be a 
Braille document although it will be appreciated that the notetaker 10 can also facilitate 
creation of a standard text document if required. Il will be appieeiatcd that in addition, the 
document being created could be saved in the usual manner on a storage device such as a hard 
disk or the like in any standard format for later retrieval. 

10 

A temporary file is then opened I m the intermediary formal, either Braille code or unicode, 
in the notetaker 10 and the operator enters 32 the document elements or objects using the input 
device 12. These elements or objects will typically be characters forming the content of the 
document and formatting codeb relating to how the document should be rendered in each 

15 environment Separate formatting codes can be entered for rendering the document differently 
in each environment. For example, a formatting code may be entered to display a particular 
sentence of the document in underlined tevt on a standard VDU in a wo;d piocossing 
environment. In contrast a separate formatting code could be entered to display the same 
sentence in Braille without underlining on a tactile display in a Braille environment 16. It will 

20 he appreciated that many of the formatting codes for one environment may not be suitable for, 
or even supported by the other environment. If the end of the input is reached then Uic pioccss 
stop^ otherwise as the elements are entered 32, the notetaker 10 translates 34 them for storage 
35 in the temporary file in the intermediary format On re the document has been eniered 33, 
the temporary file is closed 36 and retained for later use when translation of the document is 

25 required for display in a selected environment 

Figure 4 shows another aspect of a preferred operation wherein a previously created document 
k selected 40 for conversion by the nolclakcf 10. The document may originate from either a 
word processor environment 17 or a Braille environment 1 ft, for example a text document in 
30 a word processor format, or a Braille document previously created using the notetaker 10 Tfe 
notetaker 10 opens 41 a temporary file in the intermediary format and the existing document 
file. The existing document is opened from its location, directly, for example from a hard disk 
drive, or alternatively downloaded or otherwise transmitted from a remote location over a 
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network, feu example as an ©-mail attachment. The notetaker 10 then reads 42 each object 
from the existing document and converts 44 them for storage 45 in the temporary file in the 
intermediary format. If at any point the end of the file is reached the process terminates. Once 
the end of the existing file is reached, both the existing file and the icmpoiaiy file axe closed 
5 46 and the temporal y file is retained for conversion. 

Figure 5 show*> a piefcrrcd method of utilising the temporary file to transfer the electronic 
document for use in a word processor 1 7 environment, The temporary file is opened 50 in the 
intermediary format and the user selects 51 the desired word processor format which is opened. 

1 0 If they wish to export the document for \ks on a word processor, a word process format, such 
as WordPerfect™, is bclwlcd 51 and the notetaker 10 opens a suitable export file. The 
notetaker 10 fetches the temporary file 52 and translates 54 the objects for storage 55 m the 
export file in the selected woid processor format This process includes extracting and 
translating 54 the formatting codes relating to how the document should be rendered on the 

1 selected word processor. If at any point the end of the file is reached 53 then the process stops 
and both the export file and temporary file are closed The export file can then be transferred, 
for example as an e-mail attachment, Lo wuid piocessing equipment operating in the word 
processor environment 17, or alternatively saved onto disk for later retrieval The document 
may then be displayed, edited, saved and printed in the usual manner using the word processor. 

20 Further, the document maybe subsequently transferred back to the notetaker 10 for conversion 
into a suitable format for use in the Braille cttvliomncnt 16 if required. 

Alternatively Figures 6 to 8 show preferred methods of utilising the temporary file for use in 
a Braille environment 16. For example the user may want to edit the document using an output 

75 device which can either be an integral component of the notetaker 10 or peripheral devices. 
More particularly* Figure 6 shows the process for producing a hardcopy of the document by 
either an embosser or printer, or for saving the document on a disk drive for later use. 
Similarly, Figures 7 and 8 show the process for enabling editing nr reviewing of the document 
by either a Braille display or a text to speech audio device respectively, It should be noted that 

30 the flow diagrams have been separated for clarity In each case the Temporary file is converted, 
if necessary, to a suitable format which h compatible with the desired output device. 
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Rcferring to Figure 6 the temporary file is opened and then the user selects 56 what output 
device the document should be beat to. If user wishes to produce an embossed hardcopy of the 
document, the notetaker 10 first determines Y7a the format of the temporary file. If the 
temporary file is in Braille code fouuat which can be read by the embosser, then the enlire file 
is sent 62 directly to the embosser where the document is embossed 67. Alternatively if the 
temporary file is in Unicode formal, the temporary file is first converted 58 from umende to 
Braille code and the converted file is then sent 63 m the embosser where Lhc document is 
embossed ft 7. 

Alternatively, if the user wishes to produce a haidcopy text version of the electronic document, 
the notetaker 10 first determines the format 57b of the temporary file. A temporary file wtiich 
is in Unicode format can be read by the prialcj and therefore in this case the temporary file is 
sent directly 65 io the printer where the document is printed 68. Otherwise if the temporary 
tile is m Braille code format, the notetaker 10 first con veil* 61 the Braille code to Unicode and 
then sends 66 the converted Unicode file to the pirnter to print 68 a text version of the 
document. If the electronic document is to be saved on a dibk drive associated with the 
notetaker 10 for later use then the temporary file is sent 59 directly to the disk drive where it 
is saved 64 on a O )Korn, floppy disk, hard disk or the like. 

Referring to figure 7. if the user wishes 10 edit the document uu'ng a tactile Braallc display then 
an edit mode of the notetaker 10 is initiated and the temporary file is opened 50. A range of 
options 71b-7] f relating to editing axe available to the user aiid aic detected by the notetaker 
10 as the appropriate commands arc entered 71a into the notetaker 10. For example the user 
is able to move 71c the cursor to the desired location in the Lempuraiy file relating to the 
portion they wish to edit, A desired editing command can be entered 71a and the noteiaker 1 0 
performs the corresponding action, in this case performing the edit 71 f, vu the temporary file. 
The user can also view the temporary file on the Braille display 72 if required and select an end 
condition 7 i stipulating what portion Of the file is to be sent lu the display, foi example a word, 
sentence, paragraph or the like. The notetaker 10 then fetches 74 the next object from the 
temporary ti ie If the temporary file format is in Braille code 75 then the object is sent directly 
76 to a Braille code to Braille dot translator. If the temporary file format is umcode the 
notetaker 10 first converts 77 The Unicode object into a Braille code object prior to sending 76 
the object to the Braille dot translator. Once translated the Braille dot symbol is sent 78 to the 
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Braillc display. The next object is then fetched 74 from the temporary file and the process is 
continued until the end condition is reached 79, for example the end of a sentence. 



Should the user wish to edit the document using a text to speech synthesiser Ihcn a similar 
5 process is carried as shown in Figure 8. Again an edit mode of the notetaker 10 is initiated and 
the temporary file is opened 50, A range of options 8ib-81f relating to editing arc available 
to the user and are delected by uotetakcr 10 as the appropriate commands are entered Sla on 
the notetaker 10. For example the user is able To move 81c The cursor to the desired location 
in the temporary file relating to the portion they wish to edit. A desired editing command can 

10 be entered Sle and the notetaker 10 performs the corresponding action on the tcmput<ny file 
31 f. The user can also listen 82 to die temporary file using the text to speech hardware if 
required and select 83 an end condition stipulating what portion of the file is to be ouLpul. The 
notetaker 10 then fetches 84 the next object from the temporary file. If the temporary file 
format is Unicode 85 then the object is converted 86 from Unicode to a user selected formal. 

1 S If the temporary file format is Brailleeudc the notetaker 10 first converts 87 the Braille code 
object into a Unicode object prior to sending 88 the object to the converter. Once translated ihc 
object is sent 88 to the speech synthesiser. The next object is then fetched 84 from the 
temporary file and the process is continued until the end condition is reached 89, for example 
the end of a sentence at which point the speech synthesiser renders the portion of the file in an 

20 audible manner. 



Figure 9A shows an example of a preferred structure of the temporary file. The temporary file 
comprises two files 90. 91 which are read as one contiguous file for the purposes of translation. 
The entire file is split into two portions in accordance with the current cursor location, with one 
file containing elements occurring before the cuisoi 92 and the other file containing elements 
which occur after the cursor 92. This structure assists editing ot the file, whereby any editing 
of the elements in The file which occur befoic die cursor 92 are changed in the first file 90 and 
any editing which affects elements which occur after the cursor are changed in the second 
file 91. The user can add or remove IcaI fium the document at any point as required. This 
30 structure avoids the need for objects to be shifted to make room, or remove empty space in the 
file as addition/deletions are made lu die file, and as a result improves file processing speed. 
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Figiire 9B shows an example of the elemenis stored in the Temporary file. Elements or objects 
which are characters arc termed literals and elements or objects which are formatting codes can 
be referred to as tokens. Each object or element of [he file is stored sequentially in memory 93 
in the selected foinial, fui example as a Unicode object or a Braille code object, which relates 
directly to cither a literal or token 94. b'ach object 95 which relates to a token also includes a 
label 96a-96e which indicates whether the object 95 relates to formatting in a Braille 
environment 16 or formatting in a word processor environment 17. Several token objects, eg 
96a, 96b may be specified for each individual or block of literal objects, each token indicating 
one of a range of formatting codes relating lo one of the environments. 

Figure 10 is a block diagram showing components of rhe notetaker 10 which assist 
Implementation of document conversion between formats for use in each environment. Details 
of components which carry out other standard functions of the notetaker 10 not related to 
document conversion will not be descaled heie. The notetaker 1 0 includes a CPU 1 00 which 
accesses a RAM 101 in which the temporary working file 101a and other temporary data 101b 
utilised during document conversion is stoicd. The CPU 100 also implements the various 
programs which form part of the document conversion and rendering process The various 
software 105a-105h programs are stored in nun volatile meiuoiy 105 s and include a text to 
speech synthesiser 105a, user interface 105b adapted for use by visually impaired operators, 
word processor 105c adapted for use with both Biaillc and text document^ document files 
105d 3 translators 105e for converting documents between various storage format-;, e-mai! client 
105£ document format translators 105g for convening elecuonic documents into the required 
output layout, and a database 105h which contains information relating to the various codes 
and formats Utilised for document conversion. The Uduslalois 105c aic a range of programs 
carrying out various translation functions and are shown individually in Figures 10 and 1 1 

The notetaker 10 further includes various input devices 11 used to operate the apparatus 
including Braille and/or standard keyboards 104, storage devices 108 such as hard drives, 
floppy drives, CD ROMs and the like. The notetaker 10 transfers information between other 
compatible hardware in both Braille acid wuid yiucessoL environments 16, 17 via various 
communications ports- Data ports 107 such as the standard serial and parallel ports typically 
found on computer hardware are provided, for ooiiuiiumeaLiun ovei local area networks, along 
with telecommunications ports 106 for transfer of information via a modem or the like over the 
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Internet and other wide area networks. Output devices fui tendering Draillc and text 
documents are also provided including a refreshable tactile Braille display 102, a speech 
synthesiser and speaker 103 arrangement and a visual display, if icquhed. The notctakcr 10 
can also be adapted for operation with peripheral input and output equipment, for example a 
5 printer and/or embosser 1 09 to produce hard copies of Braille/text documents. 

Figures 11 and 12 show in more derail the software functions implemented by the CPU 100 
and die intcuelationships between the software and the input/output devices. Figure 10 shows 
an implementation in which the temporary file is saved in Unicode formal whereas Figure 1 1 
10 shows, an implementation where the temporary file is saved in Braille code format. Referring 
to Figure 1 0, either a Braille or text document can be input into the noteiaker 1 0 frum a storage 
device such & the disk drive 1 08 or from the Braille or standard keyboards 104. If the input 
originates from the standard keyboard 104 or disk drive 108, each element, such as a characlci 
Q or format code, or an entire file in the case of an existing document is passed directly to a 

J 15 document and user interface control 105a. If the input originates from the Braille keyboard 

jt* 104, a translator 1 10 is first used to convert the Grade 1, Grade 2 or computer Braille input 

\J from the 6 or 8 key device into Unicode Alternatively home row hrailling can be used whereby 

■ty 6 or 8 keys on the standard keyboard arc nominated as Braille input keys, and Braille 

^ characters are entered in the normal manner usmg these keys. Typically the keys "asdf * and 

.a 20 "jkl: %< on the standard keyboard are nominated for use in home row brailling. If standard text 

O input originates from the standard keyboard this k passed directly as Unicode to the user 

interface controller 1 05b. 

13 The document and user interface eonUuller 105b shown in Figure 10 enables various user and 

25 hardware preferences to be set in relation to use and rendering of an electronic document. For 
example, the user interface determines whether the output should be in a 18 or 32 cell tactile 
display format in accordance with the hardware being used, the* nature in which text to speech 
synthesiser should indicate punctuation, numbers and character attributes, and various other 
user preferences. Once the document and user interface controller 105b parses the Unicode 
30 input and inserts any further formatting codes as required the data is sent to memory 101 for 
storing in a temporary file 101a in the intermediary format, m this case in Unicode format. The 
stored document includes information relating to the content of the document and also the 
formatting of the document in each environment, tor example the layout and character 
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attributes. Once saved in ihe intermediary funnat, tlic notetaker 10 can be used to edit the 
content of the electronic document, and the formatting the document assumes in each 
environment prior to translation. 

5 The temporary file shown in Figure 10 enables conversion of the ckaionic document for use 
in cither of the environments as required The notetaker 10 includes Unicode to word processor 
format translation software 1 1 1 which is implemented on the CPU 100 tu convert the electronic 
document into a suitable format, such as Microsoft Word™, WordPerfect™, ASCII, KTH, or 
the hke, for use on a desired word processor. Once translated the document can be exported 

10 to another machine executing the word processor, for example by e-mail, disk, network 
connection or the like. From there The document can be edited, printed ui $aved in the usual 
manner on the other machine using the word processor. Similarly, a document from such a 
word processor can be imported into the notetaker 10 by way of an e-mail auadmicut, disk ; 
net woik connection or the like and then converted using the format translator 1 1 1 into Unicode 

15 for saving in a temporary file tor subsequent use in the Braille environment 16 umu# the 
notetaker 10. 

An electronic document saved as a temporary file in the Unicode intermediary format can also 
be converted for use by Braille equipment, such as the notetaker 1 0 itself, peripheral equipment 
20 or other compatible Braille equipment. Where the document is to be output to a speech 
synthesiser 103 or Braille display, fhe electronic document is first read from the temporary file 
101a and then paisedby the document and user interface controller software 100 where various 
Braille output preferences are specified 

25 To send the output to the speech synthesiser 103 the temporary file information is retrieved 
object by object until the required amount of the file haa been accessed, for example a whole 
sentence or paragraph, according Vn how much of the document the user wishes to review at 
one time. Each object is then sent to a translator program 1 14 which translates stored objects 
into individual characters and tokens which can be streamed to and interpreted by Lhe 

30 synthesiser 73 to produce the audible output. Alternatively the document can be sent to a 
refreshable tactile Braille display U)2 <?o the document can be read directly on the IS or 32 cell 
display provided by the notetaker 10. In this case the required amount of information retrieved 
from the temporary file is passed to a formatter 105g which extracts formatting information 
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from both the temporary file and user interface controller 105b to determine an appropriate 
format for the information being displayed In particular the document formatter 1 05g program 
processes the electronic document to set up the required layout of the document in accord with 
Braille document conventions, the nature of the output device and any other formatting 
5 requirements specified by the temporary file itbclf. For example, the document formatter 105g 
arranges the document content into a 40 symbol per line by 25 line per page layout which is 
usual for Braille documents. The formatter 105^ albu extracts various other formatting codes, 
such as character attributes pertaining to Braille document formatting Where Grade 1 or 
Grade 2 Braille is required a Braille translator 102 urnis the object into Braille code and a 

10 Braille code to Braille dot translator 103 rums the object into a corresponding 7 hy 4 dot array 
used to reprint the Braille character. To render compuler Braille, the output of the formatter 
105g can also be passed to a Unicode to computer Braille dot translator 106 which turns each 
character element of the temporary file into a 2 by 4 dot array each of which is passe to the 
Biaille display 102 to enable review of the document by a visually impaired operator. It a 

15 embossed hardcopy of the document is required the CPU 100 implement a Unicode to Braille 
code translator 115 which transforms the Unicode into a format which can be sent to the 
embosser 109a to produce the hardcopy. Alternatively a hard copy text vcibion of die 
document can be printed by sending the intermediary file directly to a printer 109b connected 
to the notetaker 10. A copy of the electronic document can also be saved for later uix; by 

20 transferring the Unicode file directly to a storage device 10S such as a hard disk, floppy disk, 
CDROM or the like- 
Figure 12 shows an alternative pror.e^ implemented by the CPU 100 for facilitating 
environment conversion of an electronic document using a temporary file saved in a Braille 

25 code format, The general interrelationship and functionality offered by the programs used to 
carry out the conversion processes in relation to a Braille code intermediary format are similar 
to those for the Unicode format described m Figure 10 and therefore only the differences will 
be described here. Input from the standard keyboard is passed to a Unicode to Braille code 
translator 123 before the input is pa«f*1 To the user interface controller 105b. Home row 

30 Brailling input i* passed to a Braille key to Braille code translator program 120, while standard 
keyboard input is passed to a Unicode to Krai lie code translator 123 prior to sending the input 
to the user interface controller 105b. To emboss a document the temporary file can be sent 
directly to the embosser 109a. A Braille code to Unicode translator 125 is provided by the CPU 
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100 function TO conven the temporal y file into a fomiat suitable for printing a text version of 
the document on a standard printer 109b. The Braille code-temporary file can be saved directly 
to a storage device 108 if required. If the document needs to be output to the Braille display, 
a Braille code to Braille dot 122 translator converts objects as required 



